CLAIMS 



[d] 1. A method for stabilizing an image of an object being taken from a 

video camera, the video camera being moved by a transport mechanism and 
being controlled by a line-of-sight controller, the method comprising: 
receiving a plurality of images of the object; and 
for each of the plurality of received images, 

receiving a velocity and orientation of the transport mechanism; 
receiving an orientation of the camera relative to the transport 

mechanism; 
receiving a scan and tilt rate of the camera; 
receiving a distance from the camera to the object; 
calculating an inter-frame stabilization adjustment based on the 
velocity and orientation of the transport mechanism, the 
orientation of the camera, the scan and tilt rate of the camera, 
and distance to the object; 
calculating a line-of-sight adjustment for the line-of-sight controller 

based on the inter-frame stabilization; and 
controlling the line-of-sight controller in accordance with the 
calculated line-of-sight adjustment. 

[c2] 2. The method of claim 1 wherein the transport mechanism is an 

airborne vehicle. 

[c3] 3. The method of claim 1 wherein the line of sight of the camera is 

derived from the line-of-sight controller. 

[c4] 4. The method of claim 1 including adjusting the display of the images 

based on the inter-frame stabilization adjustment. 
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[c5] 5. The method of claim 4 wherein the received images are larger than 

the displayed images and the adjusting of the display of the images moves an 
area of a displayed image within the received image. 

[c6] 6. The method of claim 4 wherein the inter-frame stabilization 

adjustment specifies the number of pixels in scan and tilt directions. 

[c7] 7. The method of claim 1 wherein the controlling of the line-of-sight 

controller specifies rate of scan and tilt movement. 

[c8] 8. The method of claim 1 wherein the distance to the object is provided 

by a range finder. 

[c9] 9. The method of claim 1 wherein the distance to the object is 

calculated based on the line of sight of the camera and the difference in altitude of 
the object and the camera. 

[do] 10. The method of claim 1 wherein the velocity of the transport 

mechanism is relative to the object. 

[di] 11. The method of claim 1 wherein the velocity of the transport 

mechanism is relative to an earth frame of reference. 

[d2] 12. The method of claim 1 wherein the calculated inter-frame 

stabilization adjustment factors in field of view of the display. 

[d3] 13. A method for stabilizing an image of an object being taken from a 

video camera, the video camera being moved by a transport mechanism and 
being controlled by a line-of-sight controller, the method comprising: 

determining a difference in the location of the object within the image from 
one frame to the next frame; 
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calculating an inter-frame stabilization adjustment based on the determined 
difference; 

calculating a line-of-sight adjustment for the line-of-sight controller based 
on the inter-frame stabilization; and 

controlling the line-of-sight controller in accordance with the calculated line- 
of-sight adjustment. 

[d4] 14. The method of claim 13 wherein the determining of the difference 

includes analyzing scan and tilt rate of the line-of-sight controller. 

[d5] 15. The method of claim 13 wherein the determining of the difference 

includes analyzing velocity of the transport mechanism. 

[d6] 16. The method of claim 13 wherein the determining of the difference 

includes analyzing line of sight of the camera. 

[d7] 17. The method of claim 13 wherein the determining of the difference 

includes analyzing orientation of the camera and the transport mechanism. 

[d8] 18. The method of claim 13 wherein the determining of the difference 

includes recognizing the object within the images. 

[ci9] 19. The method of claim 13 wherein the calculated line-of-sight 

adjustment specifies a scan and tilt rate for the line-of-sight controller. 

[c20] 20. An apparatus for stabilizing imagery from an airborne video camera, 

comprising: 

a mechanical line-of-sight controller for controlling line of sight of the video 
camera at a specified line-of-sight adjustment rate; and 

an electronic stabilization component that provides frame-to-frame image 
stabilization based on the specified line-of-sight adjustment rate and 
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that provides to the mechanical line-of-sight controller a new line-of- 
sight adjustment rate derived from an amount of frame-to-frame 
image stabilization. 



[c2i] 21. The apparatus of claim 20 wherein the amount of frame-to-frame 

image stabilization is additionally based on velocity and orientation of an airborne 
transport vehicle, orientation of the camera relative to the airborne transport 
vehicle, and distance from the camera to an object within the image. 

[c22] 22. The apparatus of claim 20 wherein the line-of-sight adjustment rate 

includes a scan rate and a tilt rate. 

[c23] 23. The apparatus of claim 20 wherein an image received from the video 

camera is larger than a displayed image and the electronic stabilization 
component provides frame-to-frame image stabilization by adjusting the location 
of the displayed image within a received image. 

[c24] 24. The apparatus of claim 20 wherein the specified line-of-sight 

adjustment rate includes a user-specified image flow. 

[c25] 25. The apparatus of claim 20 wherein the mechanical line-of-sight 

controller is a motorized gimbal system. 

[c26] 26. The apparatus of claim 20 wherein the frame-to-frame adjustment 

keeps an object of the images at the same location when displayed. 

[c27] 27. An apparatus for stabilizing imagery from an airborne video camera, 

comprising: 

a mechanical line-of-sight controller for controlling line of sight of the video 
camera at a specified line-of-sight adjustment rate; and 
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an electronic stabilization component that provides frame-to-frame image 
stabilization based on location of an object within the images and 
that provides to the mechanical line-of-sight controller a new line-of- 
sight adjustment rate derived from an amount of frame-to-frame 
image stabilization. 

[c28] 28. The apparatus of claim 27 wherein an amount of frame-to-frame 

image stabilization is additionally based on velocity and orientation of an airborne 
transport vehicle, orientation of the camera relative to the airborne transport 
vehicle, and distance from the camera to the object within the image. 

[c29] 29. The apparatus of claim 27 wherein an amount of frame-to-frame 

image stabilization is additional based on the specified line-of-sight adjustment 
rate. 

[c30] 30. The apparatus of claim 27 wherein the line-of-sight adjustment rate 

includes a scan rate and a tilt rate. 

[c3i] 31 . The apparatus of claim 27 wherein an image received from the video 

camera is larger than a displayed image and the electronic stabilization 
component provides frame-to-frame image stabilization by adjusting the location 
of the displayed image within a received image. 

[c32] 32. The apparatus of claim 27 wherein the specified line-of-sight 

adjustment rate includes a user-specified image flow. 

[c33] 33. The apparatus of claim 27 wherein the mechanical line-of-sight 

controller is a motorized gimbal system. 



[C34] 



34. The apparatus of claim 27 wherein the frame-to-frame adjustment 
keeps the object of the images at the same location when displayed. 
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35. A method for stabilizing images being taken from a video camera 
mounted on a moving vehicle, the camera having a line of sight being controlled 
by a line-of-sight controller, the method comprising: 

calculating inter-frame stabilization adjustments to account for velocity of 
the vehicle; 

displaying the images in accordance with the calculated inter-frame 
stabilization adjustments; 

calculating line-of-sight adjustments for the line-of-sight controller based on 
the inter-frame stabilization adjustments; and 

controlling the line-of-sight controller in accordance with the calculated line- 
of-sight adjustments. 

36. The method of claim 35 wherein the calculating of the inter-frame 
stabilization adjustments factors in scan and tilt rate of the line-of-sight controller. 

37. The method of claim 35 wherein the calculating of the inter-frame 
stabilization adjustments factors in line of sight of the camera. 

38. The method of claim 35 wherein the calculating of the inter-frame 
stabilization adjustments factors in orientation of the camera and the vehicle. 

39. The method of claim 35 wherein the calculating of the inter-frame 
stabilization adjustments includes recognizing an object within the images. 

40. The method of claim 35 wherein the calculated line-of-sight 
adjustment specifies a scan and tilt rate for the line-of-sight controller. 
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